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Content-based Multimedia Data Management and Efficient Remote Access 
James Griffioen, Brent Seales, Raj Yavatkar 



Abstract: 

The recent availability of low-cost powerful workstations and PCs has caused a staggering increase in 
the amount and quality of digital data, which includes still images, video clips and sound. The problem 
of managing such a large volume of information has become very important for researchers who need 
efficient and simple access to the data. In this paper we present a framework for managing the storage, 
analysis, and access of multimedia data. We address the problems of user access and data management 
via an extensible graphical user interface, which is the front-end to a semantic object-oriented 
multimedia management tool. We present a new method for efficient content-based searching of image 
and video data, and we examine several proposed solutions to the problem of network access to large 
multimedia databases. 



Introduction 

The Internet has seen explosive growth during the last few years and continues to grow at a staggering 
rate, adding new users from every imaginable profession each day. The primary reason for the enormous 
popularity of the Internet is the access it provides to vast and up-to-date repositories of information 
ranging from television footage to research publications. However, the large number of users and 
amount of information involved has prompted the need for development of utilities and software tools 
(termed middleware) that facilitate organization of repositories for easy and efficient access (searching, 
browsing, and retrieval). 

More recently, middleware applications and services such as the World Wide Web, WAIS, gopher, and 
many others have attempted to organize the masses of information and provide efficient mechanisms for 
accessing and searching the information space. Although these accomplishments represent a significant 
advance, the rapid proliferation of new information media, particularly multimedia information such as 
images, video, and sound, will require new or enhanced middleware services to effectively handle such 
information. 

We are exploring new methods for enhancing middleware services to support effective and efficient 
access to multimedia information. Specifically, we are developing techniques that allow Internet users to 
access the information embedded within multimedia documents. The system allows users to manipulate, 
enhance, and annotate existing information and share these interpretations and modification with other 
users. Our design extends middleware services to support tools for multimedia data modeling and 
organization, embedded information extraction (semantic tagging), and efficient network transfer 
policies such as cooperative proxy server caching, automatic data prefetching, and hierarchical data 
transfers. The next subsections outline our approaches to multimedia data modeling, embedded 
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Perfect picture organizers, (displaying photographs) 

Wing, Nancy 

Parents 1 Magazine, v68, nil, p223(4) 

Nov, 

1993 

PUBLICATION FORMAT: Magazine/ Journal ISSN: 1047-8574 LANGUAGE: English 
RECORD TYPE: Fulltext; Abstract TARGET AUDIENCE: Consumer 
WORD COUNT: 896 LINE COUNT: 00075 

... hang on a wall. Use small nails or picture hooks to hang frames. 

If you find that you have more great pictures than you have 
frame or display space for, occasionally replace some of the framed ones 
with others from an album to keep your photo gallery interesting. 

Photo, photo, on the wall... 

Arrange frames of different sizes, shapes, and colors together on 
a wall. The frames needn't match — in fact... 
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File 613: PR Newswire 1999-2006/Jan 17 
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11/3, K/2 (Item 1 from file: 275) 

DIALOG (R) File 275:Gale Group Computer DB(TM) 
(c) 2006 The Gale Group. All rts. reserv. 

01259584 SUPPLIER NUMBER: 06830922 (USE FORMAT 7 OR 9 FOR FULL TEXT) 

Distributed control system has program development facilities, (product 
announcement ) 

Cleaveland, Peter 

I&CS (Instrumentation & Control Systems), v61, nil, p58(l) 
Nov, 1988 

DOCUMENT TYPE: product announcement ISSN: 0746-2395 LANGUAGE: 

ENGLISH RECORD TYPE: FULLTEXT; ABSTRACT 

WORD COUNT: 588 LINE COUNT: 00050 

... in the field control stations; 

* Trend Group Displays provide trend reordings for up to 2300 tags , 
up to eight per display; 

* The Trend Point Display is used to register each point recorded on 
the trend display. 

Multi - window functions allow several display segments to be 
shown in windows on the same display. For example, several different 
instrument faceplates can be shown on a graphic display . 

BASIC programs can be used for logging/reporting, data base access , 
and interactive graphics . Up to four foreground panel- display related 
programs and two background logging and report-generation programs can run 
concurrently. BASIC programs can access process data by tag number and 
data type as well as trend data and message files. 

Communications 

Real-time. . . 



14/3, K/l (Item 1 from file: 635) 

DIALOG (R) File 635: Business Dateline (R) 

(c) 2006 ProQuest Inf o&Learning. All rts . reserv. 

0433179 93-85562 

XSoft image management capabilities with new Document Search and Retrieval 
software 

Scharf glass, Ira 

Business Wire (San Francisco, CA, US) si pi 

PUBL DATE: 930920 

WORD COUNT: 568 

DATELINE: Palo Alto, CA, US 

TEXT: 

...output scanners, giving users a simple and fast method of importing 
image documents into the database . DSR/ Image enables complete compound 
document management support, including document sharing, concurrency of 
document access, and security, among other features. 

DSR/ Image enables users to view image documents as thumbnail 
images or in their entirety, with numerous options for viewing, such as 
paging, zooming, rotating, selection of different resolutions, and viewing 
of multiple pages in multiple X Windows . DSR/Image uses IDI ' s 
BasisPlus, a market leader in full text retrieval, as its core search 
engine . 

DSR/ Image provides an effective solution to the growing compound 
document storage and retrieval and storage needs... 



14/3, K/2 (Item 2 from file: 635) 

DIALOG (R) File 63 5: Business Dateline (R) 

(c) 2006 ProQuest Inf o&Learning. All rts . reserv. 

0071852 88-30088 

FileNet Corp. Reduces Workstation Prices; Ships System Software to Support 
150 Workstations 

Warren, Eric 

Business Wire (San Francisco, CA, US) si pi 
PUBL DATE: 881011 
WORD COUNT: 675 
DATELINE: US 

TEXT: 

...text processing functions simultaneously. 

FileNet workstations allow users to access different applications by 
simply opening multiple windows on the computer screen. There is no 
need to log off the DP system, for example, to access images or text 
from different databases , " Smith said. 

"This is a distinct advantage of FileNet 's integrated workstation over 
other products being marketed today. " 

FileNet workstation functions include: 

Windowing -- allows users to simultaneously display images , data 
and text froman OSAR optical storage and retrieval library; data from 
mainframe databases ; andtext processing documents by opening multiple 
windows on the screen. 

Multi -tasking the simultaneous operation of multiple processing 
tasks that utilize all types of information resources... 



14/3, K/3 (Item 1 from file: 16) 

DIALOG (R) File 16:Gale Group PROMT ( R ) 

(c) 2006 The Gale Group. All rts . reserv. 

04147645 Supplier Number: 46055373 (USE FORMAT 7 FOR FULLTEXT) 
IBM again receives most U.S. patents, surpassing own record for a single 
year. 

Business Wire, p01101085 
Jan 10 # 1996 

Language: English Record Type: Fulltext 
Document Type: Newswire; Trade 
Word Count: 864 

... reference. This invention provides a user-friendly way to send a 

request to a remote database , and the requested sound , audio or text 
is retrieved and displayed in a window. (U.S. 5,418,908) 

o A method that organizes multiple windows on a display screen 
in proportion to the length of time each window is active. Upon 
receipt of a simple command from the user, the more active windows 
appear larger than windows that are active a shorter length of time. This 
allows an. . . 
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DIALOG (R) File 16:Gale Group PROMT (R) 

(c) 2006 The Gale Group. All rts . reserv. 

01941165 Supplier Number: 42478057 (USE FORMAT 7 FOR FULLTEXT) 
REDLAKE ANNOUNCES COMPATIBILITY LINK BETWEEN SPECTRUM-XVA and XING 
TECHNOLOGY'S JPEG COMPATIBLE SOFTWARE 

News Release, pi 
Oct 31, 1991 

Language: English Record Type: Fulltext 
Document Type: Magazine/ Journal ; Trade 
Word Count: 524 

combination of SPECTRUM- XVA and VT-Compress is a 
particularly good one; the board's multiple video window control 
allows up to 256 live or still windows to appear simultaneously on 
the screen. This is ideal for Real Estate or other Photo Data Base 
applications where images must be viewed both as icons and as full 
screen images . VT Compress stores and retrieves images 
efficiently; 

the SPECTRUM-XVA enables many simultaneous images to be quickly and 
independently positioned and. . . 



14/3, K/6 (Item 1 from file: 810) 

DIALOG (R) File 810: Business Wire 

(c) 1999 Business Wire . All rts. reserv. 

0785437 BW1115 

AVID: Avid Technology Ships AvidNews 

December 15, 1997 

Byline: Business /Technology Editors 

. . . that reside on 
journalists' desktops as well as the AvidNews news server, which 
provides the database for streamlining and managing news story 
production. Key features of the AvidNews workstation include fast, 
simultaneous manipulation of multiple documents or windows ; 
pre-defined rundown views operating with spreadsheet-style 
flexibility; and color status highlights to indicate... 

. . .AvidNews news server include Web 

access and publishing tools for internal and external applications; 

online database maintenance; and network system printing. 

AvidNews Media System 

One of the most exciting breakthroughs in newsroom computing, the 
Media System allows journalists to search and retrieve low-resolution 
media from a media server and subsequently view and edit video on 

their desktops. Shots can be marked, annotated and organized into a 

story that is . . . 



14/3, K/7 (Item 2 from file: 810) 

DIALOG (R) File 810: Business Wire 

(c) 1999 Business Wire . All rts. reserv. 

0356848 BW017 

XSOFT: XSoft announces image management capabilities with new Document 
Search and Retrieval software 

September 20, 1993 

Byline: Business Editors /Computer Writers 

. . . output 

scanners, giving users a simple and fast method of importing image 
documents into the database . DSR/ Image enables complete compound 
document management support, including document sharing, concurrency of 
document access, and security, among other features. 

DSR/ Image enables users to view image documents as thumbnail 

images or in their entirety, with numerous options for viewing, such as 
paging, zooming, rotating, selection of different resolutions, and 
viewing of multiple pages in multiple X Windows . DSR/ Image uses 
IDI's BasisPlus, a market leader in full text retrieval, as its core 

search engine . 

DSR/ Image provides an effective solution to the growing compound 
document storage and retrieval and storage needs... 
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FILENET 2: FileNet Corp. reduces workstation prices; ships system software 
to support 150 workstations 

October 11, 1988 

Byline: Business Editors/Computer Writers 

...text processing functions simultaneously. 

FileNet workstations allow users to access different applications 
by simply opening multiple windows on the computer screen. There is no 

need to log off the DP system, for example, to access images or text 
from different databases , " Smith said. 

"This is a distinct advantage of FileNet 's integrated workstation 
over other products being marketed today. " 

FileNet workstation functions include: 

Windowing allows users to simultaneously display images , data 
and text froman OSAR optical storage and retrieval library; data from 
mainframe databases ; andtext processing documents by opening multiple 
windows on the screen. 

Multi -tasking — the simultaneous operation of multiple processing 
tasks that utilize all types of information resources.. 
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DIALOG (R) File 275:Gale Group Computer DB(TM) 
(c) 2006 The Gale Group. All rts. reserv. 

01259584 SUPPLIER NUMBER: 06830922 (USE FORMAT 7 OR 9 FOR FULL TEXT) 

Distributed control system has program development facilities* (product 
announcement ) 

Cleaveland, Peter 

I&CS (Instrumentation & Control Systems), v61, nil, p58(l) 
Nov, 1988 

DOCUMENT TYPE: product announcement ISSN: 0746-2395 LANGUAGE: 

ENGLISH RECORD TYPE: FULLTEXT; ABSTRACT 

WORD COUNT: 588 LINE COUNT: 00050 

The Trend Point Display is used to register each point recorded on 
the trend display. 

Multi - window functions allow several display segments to be 
shown in windows on the same display. For example, several different 
instrument faceplates can be shown on a graphic display . 

BASIC programs can be used for logging/reporting, data base 
access , and interactive graphics . Up to four foreground panel- display 
related programs and two background logging and report -generation programs 
can run concurrently. BASIC programs... 
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DIALOG (R) File 275:Gale Group Computer DB(TM) 
(c) 2006 The Gale Group. All rts. reserv. 

01251197 SUPPLIER NUMBER: 06235382 (USE FORMAT 7 OR 9 FOR FULL TEXT) 

Landscape generation: a changing perspective* 

Chen, Yin-Pao 

ESD: The Electronic System Design Magazine, v!8, n2, p44(4) 
Feb, 1988 

ISSN: 0893-2565 LANGUAGE: ENGLISH RECORD TYPE: FULLTEXT; ABSTRACT 

WORD COUNT: 1433 LINE COUNT: 00111 

database generation system and an on-line playback system. 
LTV's previous off-line image database generation system consisted 
of a custom-built seven-lens aerial camera with Zeiss Hasselblad 3 8-mm 
Biogon lenses and 9" film. Each of the photographs had a field of view 
of 70[deg.] in both azimuth and elevation. A flying spot scanner surveyed 
the exposed areas of the seven- view frames , providing a mosaicked 
scene of approximately 4000 X 4000 elements. The resulting analog video 
was formatted using a video processor system, so that multiple NTSC 
frames (typically 72) made up each scene. The recording process provided 
for manipulation of both video... 

...to correct for film anomalies. A digitizer and computer determined the 
exposure orientations of each photograph scanned, facilitating fast 
random access of the scenes from video disk during playback. The image 
database was then recorded and transferred to video disk; each of the 
disks held up to 54,000 NTSC frames. 

Off-line Database Generation 

Some problems were encountered during the implementation of this 
system. Chief among them were... 
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... access through bit-mapped display terminals using X windows. A 

network host stores an image database and provides a user interface to 
the database , including display of images retrieved from the 
database . This user interface and retrieved images are displayed in 
windows on a user workstation or X terminal. Of course, the user 
workstation or display terminal can be interacting with multiple network 
hosts simultaneously in different sets of windows , but the ability to 
reuse information retrieved from one host is limited. And it is possible, 
through cut-and-paste utilities or screen capture utilities, to record 
images that are displayed on the screen, or to feed these images into 
local applications running on the workstation. . . 
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Publication Year: 1998 
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Language : English 
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Journal Announcement: 9807W3 

Abstract: Video is a rich source of information. It provides visual 
information about scenes. This information is implicitly buried inside the 
raw video data, however, and is provided with the cost of very high 
temporal redundancy. While the standard sequential form of video storage 
is adequate for viewing in a x movie mode, ' it fails to support rapid 
access to information of interest that is required in many of the emerging 
applications of video . This paper presents an approach for efficient 
access , use, and manipulation of video data. The video data are first 
transformed from their sequential and redundant frame-based representation, 
in which the information about the scene is distributed over many frames 
, to an explicit and compact scene-based representation, to which each 
frame can be directly related. This compact reorganization of the video 
data supports nonlinear browsing and efficient indexing to provide rapid 
access directly to information of interest. This paper describes a new set 
of methods for indexing into the video sequence based on the scene-based 
representation. These indexing methods are based on geometric and dynamic 
information contained in the video. These methods complement the more 
traditional "content-based indexing' methods, which utilize 
image-appearance information (namely, color and texture properties) but are 
considerably simpler to achieve and are highly computationally efficient. 
(Author abstract) 37 Refs. 
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Language: English Document Type: Conference Paper (PA) 
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Abstract: A hotel management information system requires a storage and 
retrieval subsystem for text and image information, but the information 
is held in heterogeneous databases in a local network environment. 
Application sharing information will become a key component of synchronous 
groupware computers and will permit the simultaneous use of off-the-shelf 
applications such as text processors and spreadsheets by a group of 
cooperating users. Special software is inserted between application and 
multiplex input streams. Application output and user input have to be 
converted between different image and window systems. This paper 
introduces the concepts of application sharing, image stream conversion and 
their combination. It presents two sharing systems with integrated image 
conversion enabling the concurrent use of a single user application and 
the use of multiple window displays. (2 Refs) 
Subfile: B C 
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area networks; management information systems; multimedia communication; 
multimedia computing 

Identifiers: multimedia information sharing; heterogeneous environment; 
hotel management information system; text; image information; heterogeneous 
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users; multiplex input streams; application sharing; image stream 
conversion; concurrent use; off-the-shelf applications 
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Abstract: In video processing, a common first step is to segment the 
videos into physical units, generally called shots. A shot is a video 
segment that consists of one continuous action. In general, these physical 
units need to be clustered to form more semantically significant units, 
such as scenes, sequences, programs, etc. This is the so-called story-based 
video structuring. Automatic video structuring is of great importance for 

video browsing and retrieval . The shots or scenes are usually described 
by one or several representative frames , called key- frames . Viewed 

from a higher level, key frames of some shots might be redundant in 
terms of semantics. In this paper, we propose automatic solutions to the 
problems of: (i) video partitioning, (ii) key frame computing, (iii) key 
frame pruning. For the first problem, an algorithm called "net comparison" 
is devised. It is accurate and fast because it uses both statistical and 
spatial information in an image and does not have to process the entire 
image. For the last two problems, we develop an original image similarity 
criterion, which considers both spatial layout and detail content in an 
image. For this purpose, coefficients of wavelet decomposition are used to 
derive parameter vectors accounting for the above two aspects. The 
parameters exhibit (quasi-) invariant properties, thus making the algorithm 
robust for many types of object/camera motions and scaling variances. The 
novel "seek and spread" strategy used in key frame computing allows us to 
obtain a large representative range for the key frames. Inter-shot 
redundancy of the key-frames is suppressed using the same image similarity 
measure. Experimental results demonstrate the effectiveness and efficiency 
of our techniques. (23 Refs) 
Subfile: B C 
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We present a vision system for the 3D model-based tracking of 
unconstrained human movement. Using image sequences acquired simultaneously 
from multiple views, we recover the 3D body pose at each time instant 
without the use of markers. The pose-recovery problem is formulated as a 
search problem and entails finding the pose parameters of a graphical human 
model whose synthesized appearance is most similar to the actual appearance 
of the real human in the multi- view images . The models used for this 
purpose are acquired from the images. We use a decomposition approach and a 
best-first technique to search through the high dimensional pose parameter 
space. A robust variant of chamfer matching is used as a fast similarity 
measure between synthesized and real edge images . We present initial 
tracking results from a large new Humans -In -Act ion (HIA) database 
containing more than 2 500 frames in each of four orthogonal views. The 
four image streams are synchronized. They contain subjects involved in a 
variety of activities, of various degrees of complexity, ranging from 
simple one-person hand waving to two-person close interaction in the 
Argentine tango. 
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Standard binary data formats are currently used to import and export 
satellite images to geographic inf ormation-and image-processing systems. 
These data structures provide a standard sequential method to read and 
write large volumes of information in a semicompressed format. While the 
binary structure is adequate for strict import of image data, it is poorly 
adapted to fast image-processing at the microcomputer level. In this study, 
new data structures are investigated that use operating codes to quickly 
convert raster binary image data and vector overlay files into a high-speed 
graphical language for efficient display and processing. Binary data is 
converted into 'picture handles' of variable size and resolution using 
2-byte operating codes to symbolize the graphical process. As a result, 
images are drawn as objects that may be coupled as independent vector 
components in multiple bit planes. The bit planes may be specified for each 
pixel to support 24- and 32-bit color of both raster and vector data. The 
efficiency of these structures allows the user to display 1024 x 1024 
scenes in multiple overlapping windows using simple Cut /Copy/ Paste 
commands. In addition, the use of operating codes allows an analyst to 
quickly store and retrieve archived images in their compressed form 
using simple 'scrap manager* techniques. Early results for this technique 
indicate that converted vector overlays may be compressed by a factor of 8 
and SPOT images (depending on scene diversity) by a factor of 2. More 
significantly, images that typically require 4 min to load from binary may 
be displayed in fractions of a second using the new display method and 
resultant operating codes. (RH) 
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This paper describes GUIDON-WATCH, a graphic interface that uses 
multiple windows and a mouse to allow a student to browse a knowledge 

base and view reasoning processes during diagnostic problem solving. 
Methods are presented for providing multiple views of hierarchical 
structures, overlaying results of a search process on top of static 
structures to make the strategy visible, and pictorially expressing 
evidence relations between findings and hypotheses. This work demonstrates 
the advantages of stating a diagnostic search procedure in a 
well-structured, rule-based language, separate from domain knowledge. A 
number of issues in software design are also considered, including the 
automatic management of a multiple - window display. (Author) 
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ABSTRACT : 

In this paper, the authors present ideas how visualization technology can 
be used to improve the difficult process of querying very large databases 
. With their VisDB system, the authors try to provide visual support not 
only for the query specification process, but also for evaluating query 
results and, thereafter, refining the query accordingly. The main idea of 
the system is to represent as many data items as possible by the pixels of 
the display device. By arranging and coloring the pixels according to the 
relevance for the query, the user gets a visual impression of the resulting 
dataset and of its relevance for the query. Using an interactive query 
interface, the user may change the query dynamically and receives immediate 
feedback by the visual representation of the resulting data set. By using 
multiple windows for the different parts of the query, the user gets 
visual feedback for each part of the query and, therefore, may easier 
understand the overall result. To support complex queries, the authors 
introduce the notation of 'approximate joins' which allow the user to find 
data items that only approximately fulfill join conditions. The authors 
also present ideas how their technique may be extended to support the 
interoperation of heterogeneous databases . Finally, the authors discuss 
the performance problems that are caused by interfacing to existing 
database systems and present ideas to solve these problems by using data 
structures supporting a multidimensional search of the database . 
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ABSTRACT : 

In this paper, the authors describe a database query system that provides 
visual relevance feedback in querying large databases . The goal of their 
system is to support the query specification process by using each pixel of 
the display to represent one data item of the database . By arranging and 
coloring the pixels according to their relevance for the query, the user 
may change the query dynamically and receives immediate feedback by the 
visual representation of the resulting data set. By using multiple 
windows for different parts of a complex query, the user gets visual 
feedback for each part of the query and, therefore, will easier understand 
the overall result. The system may be used to get any database that 
contains tens of thousands to millions of data items, but it is especially 
helpful to explore large data sets with an unknown distribution of values 
and to find the interesting hot spots in huge amounts of data. The direct 
feedback allows to visually display the influence of incremental query 
refinements and, therefore, allows a better, easier and faster query 
specification. 
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DESTRUCTION PULSE ULTRASOUND CONTRAST AGENT IMAGING 
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Main International Patent Class: A61B-008/00 
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Filing Language: English 
Full text Availability: 
Detailed Description 
Claims 

Fulltext Word Count: 1063 6 
English Abstract 

The invention is directed to improvements in diagnostic ultrasound 
contrast agent imaging. In a preferred embodiment, high pulse repetition 
frequency (HPRF) destruction pulses are fired at a rate higher than 
necessary for receiving returning echoes. Pulse parameters can also be 
changed between the plurality of contrast agent destroying pulses. Other 
preferred embodiments of the invention are directed to simultaneous 
transmission of multiple beams of destruction pulses. Destruction frames 
that consist of a plurality of destruction pulses can be triggered and 
swept over the entire region of tissue being imaged, and at a variety of 
focal depths from the transmitter (504) . The destruction frames are fired 
at some time triggered from a timer or some fixed part of a physiological 
signal, such as an ECG signal (518) . Other preferred embodiments of the 
invention are directed to continuous low power imaging pulses (806) 
alternating with destruction pulses (812) triggered at a fixed point of a 
physiological signal, and a comparison (510) of the received signals from 
imaging pulses fired before and after the destruction pulses. 

French Abstract 

Cette invention se rapporte a des ameliorations apportees a 1 1 imagerie 
diagnostique par agent de contraste ultrasonore. Dans un mode de 
realisation prefere, des impulsions de destruction a frequence de 
repetition des impulsions elevee (HPRF) sont emises a un rythme plus 
eleve que le rythme necessaire pour recevoir des echos en retour. Les 



parametres des impulsions peuvent egalement etre modifies entre la 
pluralite des impulsions de destruction de 1 ' agent de contraste. D'autres 
modes de realisation preferes de cette invention concernent la 
transmission simultanee de faisceaux multiples d' impulsions de 
destruction. Les trames de destruction qui sont composees par plusieurs 
impulsions de destruction peuvent etre declenchees et elles peuvent 
balayer toute la zone des tissus devant etre illustree, a une grande 
variete de profondeurs focales a partir de 1 ' emetteur (504). Le moment 
auquel les trames de destruction sont emises est declenche par une 
minuterie ou par une partie fixe d'un signal physiologique, tel qu'un 
signal ECG (518). D'autres modes de realisation preferes de cette 
invention concernent des impulsions d'imagerie basse puissance continues 
(806) alternant avec des impulsions de destruction (812) declenchees a un 
point fixe d'un signal physiologique, ainsi qu'une comparaison (510) des 
signaux recus a partir des impulsions d'imagerie emises avant et apres 
les impulsions de destruction. 

Legal Status (Type, Date, Text) 

Publication 20010111 Al With international search report. 
Examination 20010517 Request for preliminary examination prior to end of 

19th month from priority date 

Fulltext Availability: 
Detailed Description 

Detailed Description 

... in comparing the imaging 

frames. In one embodiment of the invention, the ultrasound imaging system 
displays two or more imaging frames side-by-side for the operator 

to visually 

compare the images to assess differences. Alternatively, the ultrasound 
imaging system tags two or more imaging frames and stores them in 
some 

image memory system, such as a frame buffer or video buffer, for example. 

When the tagged imaging frames are retrieved from the image memory 
system, the imaging frames can be visually placed next to each other, or 
a. . . 

. . .61 L " E ' 2 6) 

- 19 switch can allow the operator to quickly alternate the display of 
two or more imaging frames . In another embodiment of the invention, 
parameters derived from two or more imaging frames are displayed , 
for example in a graphical format. 

In a preferred embodiment of the invention, the ultrasound. . . 



16/5, K/l (Item 1 from file: 348) 

DIALOG (R) File 348:EUROPEAN PATENTS 

(c) 2005 European Patent Office. All rts . reserv. 



00816254 

Scenario editor for multimedia data and scenario reproducing apparatus 
Drehbucheditor fur Mult imediada ten und Vorrichtung zum Wiedergeben von 
Drehbuchern 

Editeur de scenario pour donnees multimedia et appareil de reproduction de 
scenarios 
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ABSTRACT EP 758115 Al 

A plurality of individual objects is put together to a group of page 
type objects in a page type object producing unit. When a display timing 
and a deletion timing for the group of page type objects are input, a 
page change timing of each of the page type objects in the group is 
automatically set in a page change timing setting unit to display the 
page type objects with a dynamic image at equal intervals in a display 
period between the display timing and the deletion timing. Therefore, it 
is not required to input a display timing and a deletion timing for each 
of the individual objects for the purpose of editing a scenario in which 
the individual objects are assigned to frames of dynamic image to display 
the individual objects with the dynamic image, and a scenario editing 
operation can be easily performed. 

ABSTRACT WORD COUNT: 146 
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Figure number on first page: 2 
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INTERNATIONAL PATENT CLASS: G06F-017/30 

...SPECIFICATION pages 58-66 describes a multimedia editing system 
consisting of 3 parts, namely a multimedia database , a storyboard 
editor/presentation program and a video-clip editor. Users of the system 
can add to, search and retrieve multimedia files ( images , videos 

sounds ) from the database and compose a presentation out of said 
files . 



PROBLEMS TO BE SOLVED BY THE. 



. .However, in cases where a plurality of static or text objects are 
assigned to a plurality of frames of display scene in a 
predetermined order as if page types data are assigned to pages of a. 
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Hierarchical shared books with database. 

Hierarchisch prasentierte g erne ins ame Bucher mit Datenbank. 

Livres partages avec base de donnees et presentes hierarchiquement • 
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ABSTRACT EP 473 960 A2 

A representation of a shared structured container type data object with 
related data bases can be used to present information in a hierarchy or 
multi-level mode about the activities and status relating to the shared 
container type structured data object and related data bases and its 
content of a plurality of structured data objects as well as other 
information affecting or tracking the shared container type structured 
data object content in multi-levels. Further, user access control is also 
provides exclusivity or privacy to invoked changes to parts of the shared 
container type structured data object and related data bases without 
interference from other users but with an indication to the other users 
of access control attributes thereby providing coordinated consistency 
among users relative to changes to all parts of the shared container type 
structured data object. There is also the provision for sharing a 
container with related data base and for Quick Query access to the data 
base allowing the sharing of multiple objects within the container and 
the capability of populating and querying the various objects within the 
container as well as within the data base, (see image in original 
document) 

ABSTRACT WORD COUNT: 194 
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INTERNATIONAL PATENT CLASS: G06F-015/40 



. . .CLAIMS through the use of screen text and icon representations, a method 
of access to the data base and the structured data objects 
comprising the steps of : 



entering a quick query access mode, 



selecting an information query window to provide a plurality 
of text or graphic symbol prompts, at least one of the text prompts 
including a. . . 

...text or graphic prompts to display additional prompts, 

initiating a common search of the shared data base according 
to selected graphic symbol prompts and search text, and 

displaying the results of the search of the shared data base 
in a results table on said display screen. 
8. In a electronic workstation device having... 

. . .a plurality of structured data objects, the workstation being 

electrically interconnected to a remote, shared data base , the 
screen display desktop being provided with a plurality of window 
options for access to the data base through the use of screen 
icon representations, the shared data base and the workstation 
device combining to provide a metaphor for accessing the information 
in the .provided with a plurality of window options for access to 
the data objects and the data base through the use of screen text 
and icon representations including the steps of selecting a window 
to provide a plurality of text or graphic symbol prompts, at least 
one of the text prompts including a... 

...text in said query window, selecting a least one of said plurality of 

text or graphic prompts to display additional prompts, initiating 
a search of the data objects and shared data base according to 
selected graphic symbol prompts and search text, and displaying 
the results of the search of the shared data base on said display 
screen. 

13 . In an electronic workstation device having a keyboard and display 
screen desktop, the workstation including a plurality of structured 
data objects with related data bases , the screen display desktop 
being provided with a plurality of window options for access to 
the data objects through the use of screen icon representations, the 



16/5,K/5 (Item 5 from file: 348) 

DIALOG (R) File 348: EUROPEAN PATENTS 

(c) 2005 European Patent Office. All rts . reserv. 



00412469 

ELECTRONIC DOCUMENT DISPLAY WITH ANNOTATION ROUTINES AND MULTIPLE WINDOWS. 
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. .SPECIFICATION through the stylus and/or keyboard and/or annotated with 
audio annotations input through the audio input/ output assembly. 

The present invention enables a document to be chosen from a program 
which supports the running of multiple windows . In particular, the 
multiple window support program manages a database of images and 
enables user querying of the database for desired images . The search 
results from a user query of the database provides a display of an 
image in a dedicated image window on the monitor screen. Within that 
window the user is able to view , copy, print or send the image 
displayed therein. The program enables a mazimum number, for example 3, 
of image windows to be displayed on the monitor screen at one time. 
Typically the image windows overlap one another. 
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APPARATUS FOR DOCUMENT 
WINDOW SOURCE 

VORRI CHTUNG FUR BELEGKOMMENTIERUNG UND MANI PULI ERUNG UNTER VERWENDUNG VON 
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...SPECIFICATION claiming priority of 1. Novewmber 1988, for an 

"Electronic Document Display with Annotaion Routines and multiple 
Windows" and assigned to the assignee of the present invention discloses 
a computer device which. . . 

. . .displaying the strokes input by the electronic stylus and those input 
by a keyboard. An audio input/ output assembly is alternatively 
connected to the terminal to provide voiced or other audio input to... 

...document to be annotated or created by data input through the stylus, 
keyboard and/or audio input/ output assembly. The document to be 
annotated may be chosen in three different manners. In one ... through the 
stylus and/or keyboard 1 and/or annotated with audio annotations input 
through the audio input/ output assembly. 

The present invention enables a document to be chosen from a program 
which supports the running of multiple windows. In particular, the 
multiple window support program manages a database of images and 
enables user querying of the database for desired images . The 
search results from a user query of the data base provides a display 
of an image in a dedicated image window on the monitor screen. Within 
that window the user is able to view , copy, print or send the image 

displayed therein. The program enables a prescribed number, for 
example 3 , of image windows to be . . . 
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METHOD AND APPARATUS FOR EFFICIENTLY REPRESENTING, STORING AND ACCESSING 
VIDEO INFORMATION 

PROCEDE ET APPAREIL PERMETTANT DE REPRESENTER , DE METTRE EN MEMOIRS ET 
D 1 ACCEDER DE MAN I ERE EFFICACE A DES INFORMATIONS VIDEO 

Patent Applicant/Assignee: 
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Inventor (s) : 

BERGEN James R, 

CARLSON Curt, 
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International Patent Class: G06F-17:30 
Publication Language: English 
Fulltext Availability: 

Detailed Description 

Claims 

Fulltext Word Count: 12763 
English Abstract 

A method and concomitant apparatus for comprehensively representing 
video information in a manner facilitating indexing of the video 
information. Specifically, a method according to the invention comprises 
the steps of dividing a continuous video stream into a plurality of video 
scenes (610, 612) ; and at least one of the steps of dividing, using 
intra-scene motion analysis, at least one of the plurality of scenes into 
one or more layers steps (620); representing, as a mosaic, at least one 
of the plurality of scenes; computing, for at least one layer or scene, 
one or more content-related appearance attributes (630); and storing in a 
database, the content-related appearance attributes "or said mosaic 
representations (630) . 

French Abstract 

L' invention concerne un procede et un appareil associe permettant de 
representer completement des informations video de maniere a faciliter 
1* indexation de ces informations video. Plus particulierement , un procede 
selon 1 ! invention consiste a diviser un flux continu d* images video en 
plusieurs scenes video (610, 612); au moins a diviser, en une ou 
plusieurs couches, au moins une scene prise parmi plusieurs scenes, par 
analyse d'un mouvement a 1 ' interieur d'une scene; a representer, en forme 
de mosaique, au moins une scene prise parmi plusieurs scenes (620); a 
calculer, pour au moins une couche ou une scene, un ou plusieurs 
attributs (630) de representation en relation avec le contenu; et a 
mettre en memoire, dans une base de donnees les attributs de 
representation en relation avec le contenu ou lesdites representations en 
forme de mosaique (630) . 

International Patent Class: G06F-17:30 
Fulltext Availability: 
Detailed Description 



Detailed Description 

... also comprise annotations, both visual and audible, that, e.g., 
identify portions of one or more frames or scenes, or provide some 
commentary relevant to one or more frames or scenes . 
The image vault 150, illustratively a disk array or server specifically 
designed to. . . 

...image vault 150, in response to a control signal C2 requesting, e.g., a 
specific video program, generates a video output signal S5 . 

An access engine 130, illustratively a video -on-demand server, 
generates control signals CI and C2 for controlling, respectively, the 
annotated video database 125 and the image vault 150. The access engine 
130 also receives the video output. . .a historical date in a 
documentary and the like) . 

In each of the above temporal accessing examples, the user querying 
the video information database {via an access engine) may retrieve 
several frames or scenes. However, the user may then browse through, 
e.g., the list of mosaics... 

. . .of particular interest is identified, then the frames corresponding to 
that region may be selectively displayed . 

Video information may be indexed and accessed according to content 
based attributes. Such content-based attributes include: (1) Background 
content, e.g. . . 
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VIDEO RETRIEVAL OF MPEG COMPRESSED SEQUENCES USING DC AND MOTION SIGNATURES 
EXTRACTION VIDEO DE SEQUENCES COMPRIMEES MPEG A L 1 AIDE DE SIGNATURES DC ET 
DE MOUVEMENT 
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Publication Language: English 
Fulltext Availability: 

Detailed Description 

Claims 

Fulltext Word Count: 12451 
English Abstract 

Signatures from MPEG or Motion JPEG encoded video clips are extracted 
based on the luminance, chrominance, and motion vector values. The 
signatures are stored in a database, along with corresponding location, 
size, and time length information. The signature of a query video clip, 
also encoded in the MPEG or Motion JPEG format, is extracted. The 
signature of the query video clip is comparred with the signatures stored 
in the meta database, with video clips having signatures similar to the 
signature of the query video clip identified. The video clips are then 
retrieved and displayed by selection of a user. 

French Abstract 

Dans cette invention, les signatures provenant de sequences video a 
codage MPEG ou JPEG avec animation sont extraites sur la base des valeurs 
de luminescence, de chrominance et des vecteurs de mouvement. Ces 
signatures sont stockees dans une base de donnees conjointement avec les 
informations correspondantes relatives a la position, a la taille et a la 
duree. La signature d'une sequence video d ' interrogation, egalement codee 
dans le format MPEG ou JPEG avec animation est extraite. La signature de 
cette sequence video d * interrogation est comparee avec les signatures 
stockees dans la meta-base de donnees, avec des sequences video ayant des 
signatures similaires a la signature de la sequence video d ' interrogation 
identifiee. Ces sequences video sont ensuite extraites et affichees lors 
d'une selection par 1 ' utilisateur . 

Main International Patent Class: G06F-017/30 
Fulltext Availability: 
Detailed Description 

Detailed Description 

... of the signature comparison; 

Figure 3 is a block diagram of the system architecture for video 

retrieval ; 

Figure 4 is a diagram of signature extraction from window pairs in a 
video frame ; 



Figure 5 is a diagram showing a macro block structure; 
Figure 6 is a diagram explaining derivation of bits in a... 

. .organization of signature bits; 

Figures 8(A) and 8(B) are detailed diagrams of mapping windows in 
images of different sizes; 

Figure 9 is a flowchart for mapping windows and calculating DC 
coefficients ; 
Figure 10 . . . 

. .process; 

Figures I I (A) , II (B) , II (C) , and I I (D) show examples of a 
comparison between frames in a database video clip and frames in 
query video clip in the retrieval 

process ; 

Figure 12 is a display showing a demonstration of query video 
clips and 

database video clips retrieved as displayed on a user interface. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
There . . . 
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RESTRICTED EXPANSION OF QUERY TERMS USING PART OF SPEECH TAGGING 
EXPANSION LIMITEE DES TERMES D'UNE INTERROGATION UT I LIS ANT UN MARQUAGE PAR 
NATURE GRAMMATICALE 
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Fulltext Availability: 

Detailed Description 

Claims 

Fulltext Word Count: 21779 
English Abstract 

A method for searching a database of an information retrieval system 
(fig. 3) in response to a query having at least one query word with a 
part of speech, for applying the query word to the database (142a) and 
selecting information from the database according to the query word. A 
semantic network (142d) is provided for determining expansion words to 
expand the search of the database in response to said query word. Part of 
speech (710-720) of the selected query word is determined. The selected 
query word (850) is applied to the semantic network (142d) to provide a 
query expansion word in response to the selected query word. The part of 
speech of the query expansion word is determined. The query expansion 
word is applied to the database (142a) in accordance with the part of 
speech of the selected query word and the part of speech of the query 
expansion word. 

French Abstract 

L' invention concerne un procede de recherche documentaire dans une base 
de donnees (fig. 3) en reponse a une interrogation utilisant au moins un 
mot d' interrogation avec une nature grammaticale . Le mot d' interrogation 
est applique a la base de donnees (142a) et 1 ' information est 
selectionnee dans la base de donnees en fonction du mot d' interrogation . 
Un reseau semantique (142d) est prevu pour determiner des mots 
d' expansion pour etendre la recherche dans la base de donnees, en reponse 
audit mot d * interrogation . La nature grammaticale (710-720) du mot 
d* interrogation est determinee. Le mot d ' interrogation (850) choisi est 
applique au reseau semantique (142d) pour assurer une expansion de 
1 ' interrogation en reponse au mot d ' interrogation choisi. La nature 
grammaticale du mot d'expansion de 1 ' interrogation est determine. Le mot 
d'expansion de 1 ' interrogation est applique a la base de donnees (142a) 
avec la nature grammaticale du mot d' interrogation choisi et la nature 
grammaticale du mot d'expansion de 1 ' interrogation. 

Main International Patent Class: G06F-017/27 
Fulltext Availability: 
Detailed Description 



Detailed Description 



using image text information in this manner can be referred to as 
dependent images . 

When image text-type information 460 is located by a search within 
the 

information retrieval system I 00, the image -type information 480 
associated with the located image text-type information 460 can be 
retrieved and provided to the user station 102 in accordance with the 
located image text-type information 460. If the user station 102 has 
windows software, the image and the text can be displayed in a multiple 

window 3 47, 348 or copied into a single window 348a. The image 
text-type information 460 associated with the image-type information 480 
that is used in the search process to locate an image is not 
necessarily displayed on the user station 102. 

It will be understood by the those skilled in the art that a similar 
storage and retrieval method can be provided for audio-type 
information. The audio-type information can be digitally stored in a 
system 100 database in a conventional audio information f on-nat . 



The audio-type 



Set Items Description 

51 4428316 MULTIMEDIA OR MEDIA OR AUDIO? OR SOUND? OR VIDEO? ? OR VID- 

EORECORD? OR RECORDING? ? OR ANIMATION? ? OR VOICE? ? OR AV? ? 

OR MOVIE? ? OR FILM? ? OR PICTURE? ? OR GRAPHIC? ? OR MUSIC - 
OR GAME? ? OR IMAGE? ? OR PHOTO? ? OR PHOTOGRAPH? ? OR (MOVING 

OR MOTION) ( 

52 2494221 FRAME? ? OR IMAGE? ? OR CLIP? ? OR CLIPPING OR SONG? ? OR - 

TUNE? ? OR SCENE? ? OR STILL? ? 

53 193843 DATABASE? ? OR DB OR DBMS OR RDBMS OR OODB OR DATA ( ) BASE? ? 

OR REPOSITORY OR REPOSITORIES 

54 83851 (SEARCH?? OR SEARCHING OR SEEK? ? OR SEEKING OR (LOOK OR L- 

OOKING) () (UP OR FOR) OR LOCATE? ? OR LOCATING OR LOCATOR? ? OR 
RETRIEVE? ? OR RETRIEVING OR RETRIEVAL OR FIND OR FOUND OR F- 
INDING OR FETCH?? OR FETCHING OR ACCESS?? OR ACCESSING) (5N)S1 

55 482 98 (PLURAL? OR MORE OR MANY OR SEVERAL OR MULTIPLE? ? OR MULT- 

IPLICITY OR MULT I OR DIFFERENT OR VARIOUS OR VARIED OR VARIETY 
OR NUMEROUS) (3N) (WINDOW? ? OR FRAME? ?) 

56 726782 (DISPLAY?? OR DISPLAYING OR SHOW OR SHOWS OR SHOWN OR SHOW- 

ING OR OUTPUT? ? OR OUTPUTTED OR OUTPUTTING OR PRESENT?? OR P- 
RESENTING OR VIEW OR VIEWED OR VIEWING) (5N) (SI OR S2 ) 

57 324 S4 AND S5 AND S6 

58 116 S7 AND IC=G06F 

59 44 S8 AND AY=1963:1998 

510 44 IDPAT (sorted in duplicate/non-duplicate order) 

511 44 IDPAT (primary/non-duplicate records only) 

512 76 S8 AND PY=1976:1998 

513 40 S12 NOT Sll 

514 40 IDPAT (sorted in duplicate/non-duplicate order) 

515 40 IDPAT (primary/non-duplicate records only) 
File 347:JAPIO Nov 1976-2005/Aug (Updated 051205) 

(c) 2005 JPO & JAPIO 
File 350:Derwent WPIX 1963-2006/UD, UM &UP=200602 
(c) 2006 Thomson Derwent 
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WPI Acc No: 2004-666270/200465 

Related WPI Acc No: 2000-115460 

XRPX Acc No: N04-527525 

Recorded media data playback method in data network, involves 
transmitting requests obtained by conversion of playback control signal, 
to server by transmitting one request per unit time, to store respective 
frames in server 

Patent Assignee: MICROSOFT CORP (MICT ) 

Inventor: BEALL J E; BLOCH E D; DURAND G A; HILL R 

Number of Countries: 001 Number of Patents: 001 

Patent Family: 

Patent No Kind Date Applicat No Kind Date Week 

US 6792468 Bl 20040914 US 96733478 A 19961018 200465 B 

US 99441722 A 19991116 

Priority Applications (No Type Date): US 99441722 A 19991116; US 96733478 A 

19961018 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 

US 6792468 Bl 14 G06F-015/16 CIP of application US 96733478 

CIP of patent US 6005600 

Abstract (Basic) : US 6792468 Bl 

NOVELTY - A client converts the received playback control signal 
indicating a clip to be played from a user, into several requests 
corresponding to respective individual frames of clip. The requests are 
transmitted to server at a rate of one request per unit time, so that 
the individual frames are stored in memory at server. The server 
retrieves and transmits individual frames to client at the rate of one 
frame per unit time. 

DETAILED DESCRIPTION - INDEPENDENT CLAIMS are also included for the 
following: 

(1) a playback system for media data; 

(2) a computer-readable medium stored with program for a recorded 
media data playback method; 

(3) a media data requesting method; and 

(4) a client computer. 

USE - For media data like movie data, video data, audio data, 
meta-data, etc., over data network. 

ADVANTAGE - Enables user to view a media data using a 
workstation connected to digital network. Enables accessing digitized 
movie data from different resources. Performs frame -accurate 
transportation of media data. Allows frame-accurate, random- access 
and real-time transportation of media data over a data network. 
Performs frame accurate control and playback of server-based media data 
across a data network, efficiently. 

DESCRIPTION OF DRAWING (S) - DESCRIPTION OF DRAWING - The figure 
shows a block diagram of media data playback system. 

pp; 14 DwgNo 1/7 

Title Terms: RECORD; MEDIUM; DATA; PLAYBACK; METHOD; DATA; NETWORK; 

TRANSMIT; REQUEST; OBTAIN; CONVERT; PLAYBACK; CONTROL; SIGNAL; SERVE; 

TRANSMIT; ONE; REQUEST; PER; UNIT; TIME; STORAGE; RESPECTIVE; FRAME; 

SERVE 
Derwent Class: T01 

International Patent Class (Main) : G06F-015/16 
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WPI Acc No: 2000-214441/200019 

XRPX Acc No: N00-161237 

Video random access memory for multi window display of GUI, 
computer graphic , has address converting circuit that converts address 
of rectangle area in display data and moves display position of rectangle 
data 

Patent Assignee: HITACHI LTD (HITA ); HITACHI MICRO SOFTWARE SYSTEMS KK 
(HITA-N) 

Number of Countries: 001 Number of Patents: 001 
Patent Family: 

Patent No Kind Date Applicat No Kind Date Week 

JP 11345110 A 19991214 JP 98154171 A 19980603 200019 B 

Priority Applications (No Type Date) : JP 98154171 A 19980603 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
JP 11345110 A 36 G06F-003/153 

Abstract (Basic) : JP 11345110 A 

NOVELTY - The video random access memory (VRAM) (9904) 
comprises display data which is read out periodically and sequentially 
to display control unit (9909) . Based on rule in address conversion 
database (0101) , address converting circuit (0102) modifies the address 
of the rectangle areas in the display data and hence moves the display 
position of rectangle data. 

USE - Used for multi window display of GUI, computer 
graphics . 

ADVANTAGE - The address converting circuit modifies the address of 
the image data to designation address, hence need for rewriting the 
content of the video RAM is avoided. Thus reduces access to the RAM 
accompanied by display position modification as in rerolling, panning, 
re-patterning, an animation display and moving of a window in 
graphical user interface display . Hence display position of image 
data and display content is changed at high speed. DESCRIPTION OF 
DRAWING (S) - The figure shows the block diagram of video RAM. (9904) 
Video RAM; (9909) Display control unit; (0101) Address conversion 
database; (0102) Address converting circuit. 

Dwg.1/72 

Title Terms: VIDEO; RANDOM; ACCESS; MEMORY; MULTI; WINDOW; DISPLAY; 

COMPUTER; GRAPHIC; ADDRESS; CONVERT; CIRCUIT; CONVERT; ADDRESS; RECTANGLE 
; AREA; DISPLAY; DATA; MOVE; DISPLAY; POSITION; RECTANGLE; DATA 

Derwent Class: P85; T01 

International Patent Class (Main) : G06P-003/153 

International Patent Class (Additional): G06F-012/02 ; G09G-005/14; 

G09G-005/34; G09G-005/36; G09G-005/38 
File Segment': EPI; EngPI 
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Image searching device for video frame searching and 

synchronization with corresponding recorded audio tracks from another 

source 

Patent Assignee: SONY CORP (SONY ) 
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Abstract (Basic) : EP 945862 A2 

NOVELTY - A desired frame image from a sequence of multiple 
frame images (45) is displayed on a display . The amplitude (AE) of 
audio data (47) corresponding to the selected frame image is also 
displayed on the display in an audio level panel . The frame 
image can be searched by visually confirming the amplitude of audio 
data corresponding to the desired frame image displayed . 

DETAILED DESCRIPTION - An INDEPENDENT CLAIM is included for an 
image searching device . 

USE - For searching desired frame image from a sequence of 
multiple frame images . 

ADVANTAGE - Improves the operational efficiency of image editing. 
DESCRIPTION OF DRAWING (S) - The drawing shows a representation of 
the screen display when searching the video frames . 
Amplitude (AE) 

Multiple frame images (45) 
Audio data (47) 
pp; 26 DwgNo 1/15 

Title Terms: IMAGE; SEARCH; DEVICE; VIDEO; FRAME; SEARCH; CORRESPOND; 

RECORD; AUDIO; TRACK; SOURCE 
Derwent Class: W04 

International Patent Class (Main): G06F-017/30 ; G11B-027/00; G11B-027/034 
; H04N-005/76 

International Patent Class (Additional) : G11B-027/10; G11B-027/34; 

H04N-005/78 
File Segment: EPI 
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Photographic image recording- reproducing system - controls display unit 
so as to display specified photographic images corresponding to 
respective photography places in shape of matrix, during reproduction 

Patent Assignee: MINOLTA CAMERA KK (MIOC ) 

Number of Countries: 001 Number of Patents: 001 

Patent Family: 

Patent No Kind Date Applicat No Kind Date Week 

JP 11027609 A 19990129 JP 97174483 A 19970630 199915 B 

Priority Applications (No Type Date) : JP 97174483 A 19970630 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
JP 11027609 A 19 H04N-005/76 

Abstract (Basic) : JP 11027609 A 

NOVELTY - During reproduction of stored photographic images of 
several frames selectively, the images to be searched 
corresponding to the photography place, are specified. A display 
unit (2) is controlled such that it displays specified photographic 
images in the shape of matrix. DETAILED DESCRIPTION - An image pick-up 
(7) receives photographic image of each frame, recorded in a film (F) . 
The received photographic images are stored in an image memory (11) . A 
reader (8) reads the photography places recorded magnetically in the 
film, which are then stored in an information recording unit (13). 

USE - For reproducing photographic image recorded in video tape 
for being displayed in display devices such as CRT. 

ADVANTAGE - Simplifies searching of photographic images of 
required frame to be reproduced by displaying images 
corresponding to the photography place . Enhances beauty of 
photograph, by enabling reproduction of appropriate photographic image 
and photography place, correspondingly. DESCRIPTION OF DRAWING (S) - The 
figure illustrates block diagram of photographic image recording 
-reproducing system. (2) Display unit; (7) Image pick-up; (8) 
Reader; (11) Image memory; (13) Information recording unit; (F) Film. 

Dwg.2/22 
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Graphical video image presentation control method in computer system - 
involves displaying particular video frame in response to frame 
selected by user within computer system 

Patent Assignee: INT BUSINESS MACHINES CORP (IBMC ) 

Inventor: CLINE T L; ISENSEE S H; POSTON R L; WERNER J H 

Number of Countries: 001 Number of Patents: 001 

Patent Family: 

Patent No Kind Date Applicat No Kind Date Week 

US 5828371 A 19981027 US 95561995 A 19951122 199850 B 

Priority Applications (No Type Date) : US 95561995 A 19951122 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
US 5828371 A 8 G06F-015/00 

Abstract (Basic) : US 5828371 A 

The method involves displaying a video frame icon representing 
several serially adjacent overlapping video frames within the computer 
system. A predetermined edge of the video frame icon is then selected. 

Each serially adjacent overlapping video frame is offset slightly 
away from adjacent overlapping video frame along selected edge. A small 
portion of video data is visually accessed by user within each video 

frame . A particular video frame is displayed in response to 
frame selected by user within the computer system. 

ADVANTAGE - Enables effective video presentation display 
control utilising intuitive graphical interface. 

Dwg .1/6 
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SYSTEM 
Derwent Class: T01 

International Patent Class (Main) : G06F-015/00 
File Segment: EPI 



11/5/10 (Item 10 from file: 350) 

DIALOG (R) File 350:Derwent WPIX 

(c) 2006 Thomson Derwent . All rts . reserv. 

012158593 **Image available** 

WPI Acc No: 1998-575505/199849 

XRPX Acc No: N98-448677 

Information searching method e.g. for background image , moving image 
- involves output of relevant information comprising non- linear function 
of frame, if detected position of frame containing partial moving image 
corresponds to input position co-ordinates 

Patent Assignee: HITACHI SOFTWARE ENG CO LTD (HISF ) 

Number of Countries: 001 Number of Patents: 002 

Patent Family: 

Patent No Kind Date Applicat No Kind Date Week 

JP 10257434 A 19980925 JP 9753695 A 19970307 199849 B 

JP 3093987 B2 20001003 JP 9753695 A 19970307 200051 

Priority Applications (No Type Date) : JP 9753695 A 19970307 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
JP 10257434 A 12 H04N-005/93 

JP 3093987 B2 13 H04N-005/93 Previous Publ . patent JP 10257434 

Abstract (Basic) : JP 10257434 A 

The method involves input of position information relating to 
arbitrary frames of a partial moving image with multiple frames . 
Then, a non-linear function which obtains position information 
corresponding to other frames of the moving image, is estimated. Then, 
number and frame range is set for position of each frame in the partial 
moving image, using the non-linear function. 

Then, designation of arbitrary frames during regeneration of moving 
image is performed and the non-linear function corresponding to set up 
number and range of the frame, is extracted. The position of the 
corresponding frame in the moving image is detected using the extracted 
non-linear function. If the detected position is within position 
co-ordinates used during designation operation, the information 
relevant to the set non-linear function of the frame is output . 

USE - For multimedia processing system. 

ADVANTAGE - Requires less effort for producing index of relevant 
information for partial moving image. 
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Method of navigating through video matter by displaying several key 
frame in parallel - involves highlighting presently selected keyframe 
whilst simultaneously enlarging it at multiple-sized format with respect 
to other keyframes 

Patent Assignee: KONINK PHILIPS ELECTRONICS NV (PHIG ); PHILIPS NORDEN AB 

(PHIG ); US PHILIPS CORP (PHIG ) 
Inventor: CECCARELLI M P 
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Cited Patents: No-SR.Pub 
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Patent No Kind Lan Pg Main IPC Filing Notes 
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Designated States (National) : JP KR 
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KR 2000064909 A G06F-017/30 Based on patent WO 9834182 

Abstract (Basic) : WO 9834182 A 

The method involves allowing within a single user interface 
organisation to select between a first operative mode for arranging 
keyframes in a temporally ordered manner on the screen. A second 
operative mode arranges keyframes with multiple selectible 
granularities between contiguous keyframes as displayed . Successive 
audio intervals constitute a substantially continuous audio 
representation with respect to a sequence of discretely spaced 
keyframes. An audio interval associated to an actually accessed 
keyframe is played back in the second operative mode. A presently 
selected keyframe is highlighted whilst simultaneously enlarging it at 
a multiple-sized format with respect to other keyframes. Deleterious 
video interlacing effects are detected and if so, reducing such effect 
by vertical decimation. 
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Video file recording appts with searched information display 
function in video communication system - extracts specific file from 
video file storing part and displays requisite file in screen using 
multiple window system 

Patent Assignee: CANON KK (CANO ) 
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Abstract (Basic) : JP 9050436 A 

The appts consists of a video file storing part (14) which contains 
several files. The keyboard providing unit provides keywords for all 
the files. 

The keyword of the required file is given as the input, which is 
compared with the existing keywords. The video file corresponding to 
the input keyword is extracted by an extraction unit and displayed by a 
standard information display unit. A check unit selects the file from 
the standard display unit based on an user's requirement and displays 
it in multiple windows on screen. 

ADVANTAGE - Displays several images simultaneously. Enables 
checking on stored contents of video file simultaneously. Searches 
desired video file quickly. 
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Computer implemented process for processing image signals - transmitting 
image signals from image generation subsystem to image display 
subsystem memory, followed by displaying image signals 
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Priority Applications (No Type Date) : US 93103261 A 19930806 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
US 5572232 A 15 G09G-005/04 

Abstract (Basic) : US 5572232 A 

The method involves interrogating an image display subsystem of 
a computer system with an image generation subsystem of the computer 
system to determine image display sub- system capabilities for at 
least one of a number of different types of colour format support, a 
number of different types of access to a memory of the image 
display subsystem, and a number of different types of window 
management. Subsequently the method requires generating image signals 
with the image generation subsystem in accordance with results of the 
interrogation . 

The method further entails transmitting the image signals from the 
image generation subsystem to the image display subsystem memory, 
followed by displaying the image signals. 

USE/ADVANTAGE - For displaying images on computer system 
operating in windowed environment. Improved system performance by 
reducing amount of time spent by image generation sub-system for 
copying converted video data to display . 
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Image - display method for multi - window screen - by displaying 

image data on one window and displaying arbitrary section of image 

data on remaining windows 
Patent Assignee: HITACHI LTD (HITA ) 
Number of Countries: 001 Number of Patents: 001 
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JP 8030424 A 19960202 JP 94161821 A 19940714 199615 B 

Priority Applications (No Type Date) : JP 94161821 A 19940714 
Patent Details: 

Patent No Kind Lan Pg Main IPC Filing Notes 
JP 8030424 A 5 G06F-003/14 

Abstract (Basic) : JP 8030424 A 

The method involves searching a specific image data from an 
image-data memory (9) . At least two windows are formed on a display 
screen (10) . The specific image data is shown on in one window on 
the display screen. 

The state of the coordinate position of a mouse cursor (13) on the 
display screen is entered by a mouse- information inputting part (5) and 
a mouse button (15) . The section of an image data is computed from the 
mouse information. The section of the image data is displayed on 
the remaining windows . 

USE/ADVANTAGE- For displaying image data on multi - window 
screen. Enables efficient and arbitrary display of arbitrary section 
of image data using simple operation. 
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Computer-assisted media processing method for database of stored media - 
using adaptive designation of 'in- frame 1 and 'out- frame 1 pointers to 
view , modify, annotate, store and distribute segments of media content 
stored in relational database management system 
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Abstract (Basic) : WO 9525996 A 

The method for computer-assisted media processing involves 
specifying, under control of the end-user, a set of desired values for 
one or more attributes used to index the media contents of the 
database, and searching within the database for one or more matching 
sections of media content corresp to the set of desired attribute 
values. Each of the sections of media comprise of a number of frames. A 
list identifying the matching sets of media content are displayed 
to the end-user, and under the control of the end-user, one or more of 
the sections of media content are designated. 

Under the control of the end-user, one or more beginning frames 
and one or more end- frames for one or more of the designated 
sections of media content are further designated, to define the 



selected media content. One or more media processing functions to be 
performed on the selected media content are requested, and the media 
processing functions are performed upon the selected media content. 

USE/ADVANTAGE - Processing media content stored and organised in 
database management system as sections or 'clips'. RDBMS structure 
allows user to search extensive database and identify desired content. 
Provides open architecture. 
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Multi - window display system of on-line screen - has image data 

display control unit to control display of image data searched by 

image data reference unit, on on-line screen 
Patent Assignee: NEC CORP {NIDE ) 
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Patent Details: 
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Abstract (Basic) : JP 7160634 A 

The multi - window display system has a host computer (1) and a 
terminal (2) connected by a communication circuit (3) . A display unit 
(5), an input unit (6) and an electronic filing unit (4) are provided. 
The host computer receives a reference code of the image through a 
management file registration unit (11) . 

The reference code is stored in a management file (12) . An on-line 
program (13) enables a management file reference unit (14) to search 
for the required image using the reference code. The management 
reference unit outputs an image number corresponding to the 
required image. The image data is received by the terminal into an 
image data registration unit (21) . A directory information file (22) 
consists of directory information of the image number. An image data 
reference unit (23) searches the image data in the directory 
information and outputs a storing address. The image is accessed 
in the electronic filing appts using the address and is stored in an 
image memory (24) . An image data display control unit (25) 
controls the display of the image data searched by the image 
data reference unit on the on-line screen. 

ADVANTAGE - Improves operativity. 
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Automatic microfiche frame retrieval method - designating several 
frames of different addresses, calculating positioning data and 
reading registered stored data when fiche is to be used 
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US 5222033 A 12 G06F-015/40 Cont of application US 88164168 

Cont of application US 90471691 

Abstract (Basic) : US 5222033 A 

The microfiche retrieval method involves selecting a microfiche and 
then a particular frame on the chosen microfiche. When a microfiche is 
automatically retrieved by a microfiche retrieval device, and the data 
of a target frame is input from the keyboard, the microfiche is 
conveyed to automatically retrieve the frame at the position relevant 
to the input data, and the largest frame is projected on a reader 
screen . 

The positional data for retrieving frames corresponding to the 
frame addresses other than that of the target frame and the fiche-mode 
data necessary for retrieving and outputting the imaged frames 
is stored in memory prior to retrieval of a frame. 

The stored data is read out so that the correct frame can be 
retrieved. 

USE/ADVANTAGE - for microfiche retrieval. Frames automatically 
positioned at high speed simply by designating arbitrary frames which 
are actually exposed with images 
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Interactive video image browser e.g. for retrieving or editing 
video tape data - has sampling device which one-dimensionally sampling 
animation data in vertical scan direction, while moving sampling position 
in horizontal direction and display outputs sampled images 
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Abstract (Basic) : GB 2258117 A 

The image data processing appts. includes an animation image 
generating source which supplies data of a series of animation 
images to be displayed two-dimensionally on a display screen. A 
sample data producing one-dimensionally samples the animation image 
data successively received from the image generator in one directon, 
while successively moving the sampling position in the other direction 
and produces data of a still image from the thus sampled animation 
image data . 

A display has a screen on which is displayed a group of such 
still images from the data received from the sample data producing 
device. A point designator defines a predetermined point of the still 

images displayed , and a time code converter produces a time code 
corresp. to the designated point. 

ADVANTAGE - General flow of images can be grasped readily, and 
editing may be performed at high efficiency, compared to procedure of 
applying index labels. 
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Control for audiovisual display - uses control bar and shuffler to 
operate cpu which accesses and synchronises sound and picture 
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Abstract (Basic) : WO 9005350 A 

The computer system has a central processing unit, an audio 
output for playing sounds , an audio source for generating sounds 
which is connected both to the CPU and the audio output , a visual 
output for displaying images and a visual source for generating 
them which is connected to the visual output and the CPU. to it which 
produces a number of frame segments consisting of one or more 
audio-visual frames each having visual images and accompanying sound. 

The sounds generated by the audio source can be accessed in 
any order as can the visual images, and the audio and visual material 
can be synchronised so that random access sounds and images can 
be displayed together. The user can access chosen individual frame 
segments of audio /visual information. The control includes a control 
bar and a shuffler mechanism to create apparent intelligence. 

ADVANTAGE - The facilities make the equipment versatile and user 
friendly. 
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Abstract (Basic) : WO 8703409 A 

The method includes storing the picture data of window pictures in 
a window buffer (13) . A relationship between a position on a CRT (18) 
of a reference point (e.g., left upper corner) of window picture and a 
storage position in a window buffer (13) which stores picture data on 
the reference position is stored in one memory (14) as a window 
parameter for every window picture and data for specifying the window 
picture to be displayed on each pixel is stored as a visible map in 
another memory (15) which is provided to correspond to each of the 
pixels of the picture. 

A multi - window picture is displaced through the steps of 
monitoring the present position of beam by horizontal and vertical 
counters (11,12) finding out the data from the visible map to specifiy 
the window picture displayed on a pixel on which the beam is now 
located. A window parameter is found corresponding to the above 
window picture from the first memory (14), and an address is formed 
in the window buffer (13) from the present position of the beam and the 
window parameter, reading. The picture data of the window picture is 
read and displayed it on the CRT 
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Abstract (Basic) : EP 202166 B 

The memory (4) is organised into a number of elementary rectangular 
blocks. A lookup table (6) in random-access memory contains an equal 
number of pointers, each signifying the initial address of a block. 

A video generator (10) delivers a signal corresp. to the content of 
an equal or smaller number of blocks for screen display of an image 
composed of that number in matrix array. An interface (12) affords 
access to the image memory and table in read or write mode. 

USE/ ADVANTAGE - With raster or bit-map display screen. Memory 
management is simplified by addressing symmetry. Modifiable lookup 
table allows multiple windows to be created and changed without 
physical movement of stored image. (13pp Dwg.No.2/6) 
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Abstract (Basic) : DE 3346458 A 

The video game uses a moving picture pattern generator and a still 
picture pattern generator, with a central processing device controlled 
by the operator. An image processor is then used to combine the still 
and moving pictures. 

A memory is used with the image processor to store information 
from an attribute table for use for the next successive picture during 
the horizontal image or blanking out period. An intermediate memory is 
used to store information relating to the moving picture and shown 
in the next line of the picture, while the other memory scans a moving 
line. 

GB 2133257 A 

A T.V. game system for use with a raster scanning type display 
and arranged to display at least one motion picture character on 
a screen of said display, comprising pattern data generating means for 
generating pattern data of at least one motion picture character, 
designation data generating means for generating designation data 
designating an identification and a display position of at least one 
motion picture character to be displayed on the screen of said 
display, first storing means in which the designation data, designating 
the identification and the display position of at least one motion 
picture character to be displayed in the next frame based on the 
designation data generated from said designation data generating means, 
is written during a vertical blanking period of said display, second 
storing means, into which the designation data, designating the 
identification and the 

display position of one or more motion picture characters to 
be displayed on the next following horizontal scanning line based on 
the designation data stored in said first storing means, is written 
during a horizontal scanning period of said display, third storing 
means including an area capable of storing pattern data of up to a 
predetermined number of motion picture characters which can be 
displayed on a horizontal scanning line at the same time, into which 
area pattern data of predetermined bits in the horizontal scanning 
direction of at least one motion picture character to be displayed 

as transferred from said pattern data generating means based on the 
designation data stored in said second storing means are written during 
a horizontal blanking period, and from which area said pattern data are 
read out during a next following horizontal scanning period, and means 
for supplying said pattern data read out from said third storing means 
to said display. 
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ABSTRACT 

PROBLEM TO BE SOLVED: To easily retrieve a desired video file from 
plural video files at a high speed. 

SOLUTION: A file management table provided with the fundamental information 
of a video file, that is the respective pieces of the information of key 
word, file name, directory, starting time and date and ending time and 
date, is stored in a video storage device 14. Video communication 
equipments 10-1 to 10-6 extract the pertinent video file from the inputted 
key word and display the fundamental information in a list. A user selects 
one or more video files to be displayed from the displayed 
fundamental information. The video images of the selected one or 

plural video files are simultaneously displayed by using plural moving 
image display windows set on a monitor screen. 
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ABSTRACT 

PURPOSE: To provide a film retrieval device capable of retrieving 

instantaneously a film in which an aimed frame is photographed from 
among a large number of the films in such a system that a photograph film 
is stored in a film cartridge after being developed. 

CONSTITUTION: The picture information of each frame of plural films in 
possession is read beforehand by a film scanner 30, and this read image 

information and retrieval information such as a photographing date and a 
title, etc., are recorded previously in a recording medium as being 
coordinated with the ID number of the film . Then, at the time of 

retrieving the specified film cartridge or the film in which the 
specified frame is recorded, when the retrieval information is inputted 
from the keyboard 34 of a retrieving part 32, the retrieval information and 
the retrieval information recorded in the recording medium are 
compared, and the frame corresponding to the retrieval information is 
detected. Then, this corresponding frame image is displayed on a 
monitor 38, and the ID number or the frame number of the film in which this 

frame is recorded is displayed on a liquid crystal monitor 36. If the 
corresponding frame image exists in the plural , the aimed frame is 
detected from among the candidate frames by inputting further the retrieval 
information and executing narrowing operation, etc. 
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ABSTRACT 

PURPOSE: To provide a method and device for image 
efficiently display optional cross section of image 
a display through easy operation. 



display which can 
data displayed on 



CONSTITUTION: This device consists of an image data input part 2 which 
retrieves and inputs specific image data from an image data storage 
device 9, a window generation part 3 which generates plural windows on 
the display 10, an image data display part 4 which displays the 
inputted image data on the display 10, a mouse information input part 5 
which inputs the coordinate position of a mouse cursor 13 moving on the 
display 10 and the state of a mouse button 15, an image cross section 
calculation part 6 which calculates the cross section of the image data 
from the inputted mouse information, and a control part 8 which controls 
those respective parts . 
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ABSTRACT 

PURPOSE: To easily designate a desired partial image in an image file where 
the partial images are projected. 

CONSTITUTION: When an image of a large original size is divided into blocks 
and then fetched as the image data, a retrieval control means 110 

displays a reduced image in response to the original image with no 
limitation caused by the divided boundaries. Then the area designated by an 
input means 111 is pointed in the reduced image by a selected area pointing 
means 19. Therefore an operator can recognize the designated area in 
relation to the entire original image . The selected area display means 
14 and 17 show the areas designated by the means 111 in the windows 

different from that of the reduced image. Thus the operator can recognize 
an area that is designated regardless of the entire original image. Then 
the operator can correctly recognize the display contents when the image 

data of the designated area are displayed. 
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ABSTRACT 

PURPOSE: To provide an automobile image tracking device capable of reducing 
the influence of a white line, dirt, a shadow, etc., on a road and having 
high tracking accuracy and high reliability by dividing a tracking window 
and distinguishing the preceding vehicle from other noises based on 
distance data in the divided window. 



JOURNAL : 



CONSTITUTION: This picture tracking device is provided with image sensors 
1, 2 for picking up images, memories 5, 6 for storing respective picture 

signals outputted from the sensors 1, 2, a recognizing means for 
recognizing a target to be tracked based on the picture signals stored in 
the memory 5, a window setting means for dividing a window into plural 
parts and setting up the divided windows in the picture signals of the 
recognized target, a distance computing means for retrieving the same 

picture signal as the picture signal in which one of the divided windows 
is set up from the memory 6 and computing a distance up to an object 
indicated by the picture signal in each window, and a CPU 11 having a 
judging means for judging whether a pickup image is the tracked target or 
not based on the difference of the distance computed in each widow. 
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ABSTRACT 

PURPOSE: To provide a device to perform the list screen display of plural 
images for the retrieval of a recorded image and to improve the 
resolution of a list display screen in a still picture filing device. 

CONSTITUTION: Inputted image data is stored in image memory 2, and one dot 
out of four dots is validated and reduced in a horizontal direction from 
stored data by a CPU 3, and when a vertical direction shows the image 
data in field display , one line is generated by taking a mean value from 
the filed at every two lines, and reduced data is generated, and when the 
vertical direction shows frame display , the reduced data is generated 
similarly by taking the mean value at every two lines setting one field as 
a corresponding field, and the data reduced by such procedure is 
accumulated in memory 8 by conforming to an original image , and when 
retrieval is performed, plural reduced window screens are list- 
displayed by frame scan. 
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ABSTRACT 

PURPOSE: To easily designate a position in the shape displayed as a graph 
by enabling an observer to arbitrarily select a position of analysis result 
evaluation at the time of displaying the graph of the analysis result of 
the three- dimensional complicated shape obtained by a computer. 
CONSTITUTION: Pictures of an analysis area 7 viewed in plural 
directions which include a picture 4 viewed from a virtual search 
machine 8 and a picture 2 viewed from the observer are displayed in 

multiple windows , and the search machine 8 is moved to a designated 

position on the picture , and its present position 8a and locus 9 are 

displayed on the picture , and information 11 to 15 used for physical 
quantity calculation in respective positions on the locus are stored, and 
physical quantities are calculated and are displayed as a graph 10 on the 
locus after the end of movement of the search machine 8. 
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ABSTRACT 

PURPOSE: To display a desired window capable of making access to an access 
enable state without performing an operation to close the window in use or 
to search the desired window capable of making access to a screen every 
time in the case of accessing the window of another service program while 
searching information in an information search system by opening plural 
windows on one display picture . 



CONSTITUTION: A window ID is imparted to each window, a network connection 
control part 6 for the information network of an information search system 
1 is provided with a managing table for which information displayed on 
the display picture is made correspondent to the window ID, the window 
ID corresponding to the inputted area designated the position on the 
display picture is provided from the managing table, and a window 

display control part 4 switches and controls the picture so as to make 
directly access to the window provided with this window ID. 
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ABSTRACT 

PURPOSE : To obtain the display control method and device of a nrulti 
moving image window displaying plural moving image windows 

without degrading image quality based on the priority order of a display 
even when plural moving images are superposed. 

CONSTITUTION: Display area designation memories RM(sub 0)-RMn capable of 
designating a display area in display pixel and a display priority order 
control table 2 are provided and the outputs of frame memories FM(sub 
l)-FMn are switched by a priority display decision logic at a display 
timing corresponding to the display pixel. Then, the moving window of an 
optional size and an optional shape is superposed and displayed . Then, 
the operability of a video moving image, etc., when a conference is 
performed by a work station or a personal computer fetching the video 
moving image of multi inputs, is improved. 
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ABSTRACT 

PURPOSE: To easily and precisely diagnose a generating state of abnormality 
by constituting the device so that an ultrasonic difference image of a high 

frame rate can be displayed like a column and in a time series on a 
display screen by allowing it to be subjected to reducing conversion by 

several frames each, and also, a specific image can be displayed by 
switching it to regular display magnification. 

CONSTITUTION: Echo data from the inside of a subject to be examined 
obtained by an ultrasonic operation using an ultrasonic probe 1 is stored 
in a first image memory 6 in a state that it can be displayed as an 

image , and a difference image is generated by executing successively 
subtraction 7 between two picture elements of a time series from a 
tomographic image fetched to this memory 6 and stored in a second image 
memory 11. Subsequently, when a display mode, a display time, a 

display start image , etc., are set by each of setting means 31, 33, 34, 
etc., image data read out of a second image memory 11 is displayed like a 
column on a display screen of an image display device 15 through a 

display magnification converter 12, a display converter 13, and a display 
switch 16. Also, when an abnormal image is designated, its image is 

displayed by regular magnification. 
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PURPOSE: To 
high speed. 



ABSTRACT 

control the hierarchizing display of 



plural windows at 



CONSTITUTION: Output image data memory 8 is provided with words 

equivalent to the number of picture elements constituting an output 

image , and pixel data for expressing the color of the picture element 
is stored in it. Output image control data memory 10 is provided with 
the words equivalent to the number of picture elements constituting the 

output image , and information required for control is stored in it, and 
it is composed of a RAM with fast access speed. An output image 
memory control part 12 performs the read/write control of the pixel data 
and the discharge control of the pixel data from a periodical serial port 
on the output image data memory 8, and the read/write control of 

control data on the output image control data memory 10, etc. A pixel 
data write decision part 19 decides whether or not the write of the pixel 
data on the output image data memory 8 is permitted based on 

designation information at every picture element read out on to an output 
image control data bus 11 and representing whether or not the write 
should be permitted. 
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ABSTRACT 

PURPOSE: To improve the operability of a user by apparently extending the 
size of a frame memory so as to enlarge an area enabling display and 
displaying image data on plural displays so as to easily perform 

access to objective image information by the user in the case of 
executing multiwindow display. 

CONSTITUTION: Display data A on the storage area P of a storage device are 
mapped onto a virtual display space Q, plural arbitrary segmenting 

frames Qa and Qb are selected out of the virtual display space Q, 
respective read addresses on the storage device are calculated 
corresponding to . the image information in the respective selected 
segmenting frames Qa and Qb, and the image information stored in the 
storage device corresponding to the respective real addresses is displayed 

by plural image display devices . 
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ABSTRACT 

PURPOSE: To improve operability by previously storing the initial display 
picture of a multi - window , clearing the picture displayed on a 
display when a return command is applied, and displaying the initial 
picture . 

CONSTITUTION: Respective file data to be displayed on the multi - window 
are outputted from a computer system 1, they are displayed on the multi - 
window of this display 3. At such a time, an initial picture storage part 

6 stores the initial state of the multi - window picture as the initial 
picture . When access by an operator is completed, a timer 7 is 

activated. After the lapse of time set in advance, the timer 7 outputs a 

signal to a command set part 5 so as to return the picture to the initial 

state, and the command set part 5 receives this signal and supplies it to a 
picture display part 8. Thus, the picture display part 8 reads the 

initial picture data of the multi - window stored in the initial 
picture storage part 6, and the display 3 is returned to the initial 

picture . 
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ABSTRACT 

PURPOSE: To improve workability for retrieving a medical picture by 
selecting a desired directory in an X-ray CT or the like and successively 
projecting all the pictures in the selected directory as mentioned above at 
prescribed intervals. 

CONSTITUTION: A directory display screen 1 projects the pictures of the 
directory by a display monitor connected to a memory circuit 2 for 
directory display . A picture display screen 3 projects CT pictures or 
the like by a display monitor connected to a memory circuit 4 for 

picture display . A cursor switch 6 selects the directory of a patient 

on the directory display screen 1 and the pictures of the 
above-mentioned patient are read out of a magnetic disk 8. A display mode 
is set to a cine- display mode or a multi - frame display mode in 
advance. In the cine- display mode, all the pictures in the memory 
circuit 4 are successively projected at prescribed time intervals on the 

picture display screen 3. In the multi - frame display mode, all 

the pictures are simultaneously projected. 
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ABSTRACT 

superpose each media in the same work area by setting an area 
fluctuation area of information related to the switched media 
and an unredisplay area as a redisplay area, when a redisplay is 
interrupted by a redisplay control means. 
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containing a 



CONSTITUTION: A superposition controller for media is provided with a 
frame retrieving means 2 for retrieving a superposition frame, a frame 
generating means 3 for setting newly the superposition frame unless the 
frame concerned exists, and a frame information generating means 4. In such 
a state, in the case of superposing and displaying different media in 
the frame of the media being in the course of work at present , with 
respect to the frame being in the course of work, the superposition frame 
is retrieved, based on frame information of a frame information calculating 
means, and in the retrieved frame, input editing is executed. Also, when a 
mouse operation is executed in the process of a redisplay, the redisplay is 
interrupted by a redisplay control means 8 at that point of time, and a 
redisplay area calculating means 7 sets an area containing both a text 
change area and an unredisplay area as a redisplay area. In such a way, at 
the time of switching from one media to the other media, they are 
superposed and both of them coexist easily. 
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ABSTRACT 

PURPOSE: To execute the file retrieval at a high speed and to 
satisfactorily hold the compression efficiency by providing a block 
constituting means having a function for bringing low frequency side 
component data in frequency component data to reverse orthogonal 
transformation and constituting an image of every block, in the case a 
retrieval instruction is received. 



CONSTITUTION: When an image retrieval instruction is outputted from a 
controller 1 which receives a retrieval instruction from an operator part 
8, compressed data is read out successively from an optical disk device 6, 
and supplied to an arithmetic processing circuit 5. The arithmetic 
processing circuit 5 expands and decodes the received image data by an 
expanding/compressing part 51, and brings it to reverse quantization. 
Subsequently, a block constituting means separates only DC component data 
being the lowest frequency component from in each frequency component data 
in a frequency component separating part 53, and an image forming/block 
separating part 55 makes a reduced picture on a frame memory 4 by using 
only a DC component of each block. Next, a monitor 7 displays a multi 
-screen on this frame memory 4. In such a way, the file retrieval can be 
executed at a high speed without causing the deterioration of the 
compression efficiency. 
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ABSTRACT 

PURPOSE: To instantaneously display a desired image with a simple 
operation by storing the image once displayed in an auxiliary storage 
together with a retrieving key after input of this key. 

CONSTITUTION: A retrieving key is designated and the data on the image 
once displayed and the retrieving key are inputted via an input/output 
device 6 and stored in an auxiliary storage 8 in a pair. These stored 
retrieving keys are displayed in a list. An operator designates the 
optional one of these retrieving keys as well as the optional one of the 
multi - window display screens of the device which are previously set in 
plural types. As a result, the images corresponding to the designated 
retrieving keys are displayed on the designated multi - window 
display screen. Thus a desired image can be instantaneously displayed 
with a simple operation. 
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ABSTRACT 

PURPOSE: To structure an inexpensive system that plural users can use at 
the same time by providing a means which switches window information. 

CONSTITUTION: A window memory control part 11 accesses a window memory 12 
stored with window information and the data is stored in one of four VRAMs ( 
video random access memory) 14 through a separation part 13 which 
separates and sends out plural pieces of window information. Which VRAM 
14 the data is stored in is determined according to signals of Sigl and 
Sig2 . Data which is outputted from the serial port output of the VRAM 14 is 
sent to a monitor display 16 through an RGB conversion part 15. 
Consequently, the same picture or different picture are projected on 
respective monitor displays . 
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ABSTRACT 

PURPOSE: To display a registered picture original by reflecting the 
thickness as if it is filled in a binder and to visually retrieve by 
forming simultaneously windows for plural sample pictures on a 
display . 

CONSTITUTION: In a picture retrieving device 11, a circuit for 

enlarging and reducing a picture image and a circuit or the like for 
compressing and extending picture information are disposed and the windows 

for the plural sample pictures are simultaneously formed on the 

display 15. Namely, a bookshelf 31, a binder managing register 32, the 
binder 33 and picture information 34 are displayed according to the 
instruction of a cursor and a pointing device 16 to select the desired 
picture information from the plural sample pictures. Thereby, the 
registered picture original can be displayed by reflecting the 
thickness as if it is filed in the binder, the number of the pages of the 
respective picture information and the sample picture can be displayed 

according to the movement of the cursor to visually retrieve a desired 

picture . 
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ABSTRACT 

PURPOSE: To easily install the title device and to operate the device for 
24hr by composing the device of an extended bus adapter, a CRT display 
device connected to a plotting processor, an optical disk interface 
connected through a picture bus to the plotting processor, and an input 
output interface connected to the picture bus. 

CONSTITUTION: A retrieving instruction for geography information is 
inputted by instructing a destination, out of an attribute data list 
displayed on the multi - window of a CRT3 screen, with a pointing device 
4. As the result, a map including the destination is retrieved out of 
image information maps stored in an optical disk 1 through an optical 
disk driver part by a retrieving processing part in a program group in a 
work station, and the retrieved map is displayed as a background drawing 
through a displaying driver part on the CRT3 screen. Thus, the device can 
be installed easily, and it can be operated for 24hr. 
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ABSTRACT 

PURPOSE: To retrieve a desired picture quickly by reading plural 
frames of picture signal data from a memory cartridge, reducing the size 

to form a multi original picture, reading at first the multi original 
picture from a storage medium and displaying it on a monitor. 



CONSTITUTION: A processing means 24 generates a reduced picture being the 
result of reducing a still picture represented by a picture signal based on 
the read picture signal from the 1st semiconductor storage modules 10, 12 
and stores the data of reduced picture into the 2nd storage means. The 
reduced picture stores the picture data representing the picture of single 
frame arranged for plural number into the 2nd storage means 30 and the 
processing means allows the 1st storage means 3 2 to store the picture data 
on a storage medium 34. Thus, the retrieval of the picture on the 
multi-screen is quickened. 
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ABSTRACT 

PURPOSE: To easily obtain a beautiful synthesized display of documents 
and pictures by setting plural arbitrary areas of one-page components of 
picture read by a picture input means and expanding/ reducing them to 
automatically lay out them in plural preliminarily set framed areas. 

CONSTITUTION: Frames to which pictures should be fitted are preliminarily 
designated in the document displayed on a high-resolution bit map display 
device 7 through a document processing part 5 and a picture display 

processing part 3 (these frames are not erased by functions of a picture 
input processing part 1 and a picture editing processing part 2), and 
pictures subjected to the picture input processing and the picture editing 
processing are automatically fitted to these frames and are registered in a 
document /picture storage device 8 by a picture register processing part 4, 
and the document and pictures are synthesized and are displayed on the 
high-resolution bit map display device 7 again. A storage device 6 for the 
high-resolution bit map display device is directly accessed from the 

picture input processing part 1 to facilitate the picture editing, and 
the document and picture synthesizing processing is easily performed. 



